STOCHASTIC PERRON'S METHOD AND VERIFICATION 
WITHOUT SMOOTHNESS USING VISCOSITY COMPARISON: 
OBSTACLE PROBLEMS AND DYNKIN GAMES 



ERHAN BAYRAKTAR AND MIHAI SiRBU 

Abstract. We adapt the Stochastic Perron's method in [T] to the case of 
double obstacle problems associated to Dynkin games. We construct, sym- 
metrically, a viscosity sub-solution which dominates the upper value of the 
game and a viscosity super-solution lying below the lower value of the game. 
If the double obstacle problem satisfies the viscosity comparison property, then 
the game has a value which is equal to the unique and continuous viscosity 
solution. In addition, the optimal strategies of the two players are equal to the 
first hitting times of the two stopping regions, as expected. The (single) obsta- 
cle problem associated to optimal stopping can be viewed as a very particular 
case. This is the first instance of a non-linear problem where the Stochastic 
Perron's method can be applied successfully. 



1. Introduction 

In [T], the authors introduce a stochastic version of Perron's method to con- 
struct viscosity (semi)-sohitions for linear parabohc (or eUiptic) equations, and use 
viscosity comparison as a substitute for verification (Ito's lemma). 

The present note extends the Stochastic Perron's method to the case of (double) 
obstacle problems. The conceptual contribution of the present note lies in the 
proper identification of stochastic sub- and super- solutions for the obstacle problem 
(see Definitions 12.11 and 12.21) . The technical contribution consists in proving that, 
having identified such a definition of stochastic solutions, the Perron's method 
actually does produce viscosity super- and sub-solutions. Technically, the proofs 
turn out to be very different from [Tj . The short paragraph before Lemma 12.31 
singles out the difficulty in trying to follow the results in fT. As the reader can 
see below, Definitions 12.11 and 12.21 are tailor-made to fit the proofs, thus avoiding 
considerations related to Markov processes. 

The purpose of the present note is to explain how to adapt the Stochastic Perron's 
method to this very first non-linear case. In order to keep the presentation short 



Date: January 30, 2012. 

2010 Mathematics Subject Classification. Primary 60G40, 60G46, 60H30; Secondary 35R35, 
35K65, 35K10. 

Key words and phrases. Perron's method, viscosity solutions, non-smooth verification, com- 
parison principle. 

The research of E. Bayraktar was supported in part by the National Science Foundation under 
grants DMS 0906257, DMS 0955463, and DMS 1118673. 

The research of M. Sirbu was supported in part by the National Science Foundation under 
Grant DMS 0908441. 

Any opinions, findings, and conclusions or recommendations expressed in this material are 
those of the authors and do not necessarily reflect the views of the National Science Foundation. 



2 



ERHAN BAYRAKTAR AND MIHAI SIRBU 



and simple, we therefore use a very similar framework (and notation) as in [T] 
namely that of: the state space is the whole R'^, there is a finite time horizon T, 
there is no running-cost and no discounting. The obstacle and the terminal pay-off 
are bounded, in order to avoid any issue related to integrability. However, our 
method works for more general obstacle problems, including all features assumed 
away as described above. In particular, the method can be applied to elliptic 
obstacle problems rather than parabolic. 

Optimal stopping and the more general problem of optimal stopping games (so 
called "Dynkin games" , introduced in [2J ) , are fundamental problems in stochastic 
optimization. If the optimal stopping is associated to Markov diffusions, there are 
two classic approaches to solve the problem: 

1. The analytic approach consists in writing the Hamilton- Jacobi-Bellman equa- 
tion (which takes the form of an obstacle problem), finding a smooth solution and 
then go over verification arguments. The method works only if the solution to the 
HJB is smooth enough to apply Ito's formula along the diffusion. This is particu- 
larly delicate if the diffusion degenerates. 

2. The probabilistic approach consists in the analysis of the value function(s), 
using heavily the Markov property and conditioning, to show a similar conclusion 
to the analytic approach: it is optimal to stop as soon as the player(s) reach(es) 
the contact region between the value function and the obstacle. 

We provide here a new look to the the problem of optimal stopping and Dynkin 
games. Our approach is a probabilistic version of the analytic approach. The prob- 
abilistic arguments rely only on Ito's formula (which is applied to smooth test func- 
tions), without using the Markov property of solutions of the SDE. The Markov 
property is not even assumed. The fine interplay between how much smoothness 
is needed for a solution of a PDE in order to apply Ito's formula along the SDE 
is hidden behind the definition of stochastic super- and sub-solutions, which traces 
back to the seminal work of Stroock and Varadhan j5]. We could summarize the 
message of Theorem [221 as: if a viscosity comparison result for the HJB holds, then 
there is no need to either find a smooth solution of the HJB, or to analyze the value 
function(s) to solve the optimization problem. Formally, all classic results hold as 
expected, i.e., the unique continuous (but possibly non-smooth) viscosity solution is 
equal to the value of the game and it is optimal for the player ( s) to stop as soon as 
they reach their corresponding contact/ stopping regions. 

2. The set-up and main results 

Fix a time interval T > and for each < s < T and a; £ R'* consider the 
stochastic differential equation 

f dXt^b{t,Xt)dt + a{t,Xt)dWt, s<t<T, 

— X- 

We assume that the coefficients b : [0, T] x M'' ^ and cr : [0, T] x M'' ^ Md.d' (R) 

are continuous. We also assume that, for each (s,a;) equation llj has at least a 
weak non-exploding solution 

({xr)s<t<T. (w^/'^).<t<T, p^'^ (-^t '").<t<T) , 

where the W^'^ is a d'-dimensional Brownian motion on the stochastic basis 
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and the filtration {J^t'^)s<t<T satisfies tlie usual conditions. We denote by A"*'^ 
the non-empty set of such weak solutions. It is well known, for example from [4], 
that a sufficient condition for the existence of non-exploding solutions, in addition 
to continuity of the coefficients, is the condition of linear growth: 

\b{t,x)\ + \a{t,x)\ <C(l + |x|), {t,x) e [0,r] xR'^. 

We emphasize that we do not assume uniqueness in law of the weak solution. In 
order to insure that X"'^ is a set in the sense of axiomatic set theory, we restrict 
to weak solutions where the probability space is an element of a fixed universal 
set S of possible probability spaces. For each {s,x) G [0,T] x R** we choose a fixed 
solution X'^'^ as above, using the axiom of choice. We do not assume that the 
selection is Markov. 

Let g : K'^ — K be a bounded and measurable function (terminal pay-off). Let 
also l,u : [0, T] X M'' ^ R be two bounded and measurable functions satisfying I < u. 
The functions Z, u are the lower and the upper obstacles. Assume, in addition, that 

m-)<g<u{T,-). 

For each weak solution X^'^ we denote by 7"*'^ the set of stopping times t (with 
respect to the filtration {J-'t'^)s<t<T) which satisfy s < t < T. The first player 
chooses a stopping time p G T^'^ and the second player chooses a stopping time 
T e 7"^'^, so that the first player pays to the second player the amount 

J{s, X, r, p) := E^'- [I{.<p}/(t, X^'^ + I{,<,^,<T})w(p, X^'^) + I{,^p=t}5(^t'")] • 

We are now ready to introduce the lower value of the Dynkin game 

v^:{s,x) := sup inf J{s,x,T,p) 

and the upper value of the game 

v*{s,x):= inf sup J{s,x,T,p). 

The lower and the upper values satisfy 

and, if the two functions coincide we say that the game has a value. 

Remark 2.1. At this stage, we cannot even conclude that and v* are measur- 
able. 

// the selection X'^'^ is actually Markov, we usually associate to the game of 
optimal stopping the nonlinear PDF (double obstacle problem) 



(2) 

where 
(3) 



F{t,x,v,vt,v,,v,^) = 0, on [0,T) x R'', 
u{T, •) = g, 



F{t,X,V,Vt,Vx,Vxx) ■ = 

max{w — u, min{— — Ltv, v — I}} = min{w — Z, max{— — Ltv, v — u}}, 
and the time dependent operator Lt is defined by 

{Ltu){x) {b{t, x), Vii(i, x)) + ^Tr{cr{t, x)a'^{t, x)\/lu{t, x)), <t <T, x 
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The second equality in (jSj relies on the assumption that the obstacle are ordered, 
/ < u. 

2.1. Stochastic Perron's method. The main conceptual contribution of the 
present note is contained below, in the proper definitions of stochastic super and 
sub-solutions of the parabolic PDE ([2|) in the spirit of [5] and following our previous 
work in [1]. In order to have a workable definition of stochastic semi-solution for 
the (double) obstacle problem, two very important things have to be taken into 
account: 

(i) (conceptual) one has to account for the stochastic sub-, super-solutions 
along the diffusion to be sub-, super- martingales inside the continuation 
rcgion(s). However, the diffusion may re-enter the continuation region after 
hitting the stopping region. In other words, the martingale property until 
the first hitting time of the stopping regions after the initial time may 
not be enough. The definition should start at stopping times (possibly 
subsequent to s) rather than at s, where s is the starting time. 

(ii) (technical) semi-solutions are evaluated at stopping times, so the Optional 
Sampling Theorem has to be built in the definition of sub- and super- 
martingales, in case semi-solutions are less than continuous. This idea can 
eliminate an important part of the technicalities in the previous work on 
the linear case 1 , if used directly. However, we choose below a different 
(and arguably better) route, where semi-solutions of ([2]) are continuous. 
This can be achieved due to the technical Lemma 12.41 resembling Dini's 
Theorem. Continuous semi-solutions together with Dini's Theorem can 
also eliminate the technical difficulties in 1 . 

Definition 2.1. The set of stochastic super- solutions for the parabolic PDE ([2|). 
denoted by , is the set of functions u : [0, T] x R*^ — > R which have the following 
properties 

(i) are continuous (C) and hounded on [0,r] x R'^. In addition, they satisfy 

V > I and the terminal condition v{T, ■) > g. 

(ii) for each (s, x) G [0, T] x R'^, and any stopping time ti G 7"*'^, the function 

V along the solution of the SDE is a super-martingale in between ti and 
the first (after ti) hitting time of the upper- continuation region {v) :— 
{v > u} . More precisely, for any ti < T2 G T'^'^ , we have 

where the stopping time /?+ is defined as 

p+{v, s, x, Ti) : = mi{t G [n, T] : v{t, X"^^) > u{t, X'''')} 

= mi{te [n,T] ■.X^^''eS+{v)}. 

Remark 2.2. The super-solution property means that, starting at any stopping 
time Ti > s, the function along the diffusion is a super- martingale before hitting 
the upper stopping region S^{v) := {v > u}. This takes into account the fact 
that the stopping time ri may be subsequent to the first time the diffusion enters 
the stopping region S~^{v) after s. In other words, it accounts for the possibility 
to re-enter the continuation region. Building in the Optional Sampling Theorem 
(i.e. considering the later time T2 stochastic) does not make a difference, since v 



a.s. 



STOCHASTIC PERRON'S METHOD 



5 



is continuous. However, a definition involving stopping times had to be considered 
anyway, since the starting time ti is stochastic. 

In order to simphfy the presentation, we would like to explain the notation: 

(i) usually, stopping times relevant to the first (minimizer) player will be de- 
noted by p (with different indexes or superscripts) and stopping times rele- 
vant to the second (maximizer) player will be denoted by r (with different 
indexes or superscripts) 

(ii) the superscripts + and — refer to hitting the upper and the lower obstacles, 
respectively. 

Definition 2.2. The set of stochastic sub-solutions for the parabolic PDE ([2|). 
denoted by V^, is the set of functions v : [0,r] x R'' — R which have the following 
properties 

(i) are continuous (C) and bounded on [0,r] x R''. In addition, they satisfy 

V <u and the terminal condition v{T, ■) < g. 

(ii) for each {s,x) € [0,T] x R'^, and any stopping time pi £ T'*'^, the function 

V along the solution of the SDE is a sub-martingale in between pi and the 
first (after pi) hitting time of the lower continuation region {v) :— {v < 
I}. More precisely, for each pi < P2 €z T"'*'^, we have 

v{pi,x;f) < [v{p, A r-,x;;;^_)|j-j 

where the stopping time is defined as 

T-{v,s,x,pi) : = M{t G [pi,T] : v{t,X'''') < l{t,X''-)} 
= inf{i e [pi,T] ■.X''^' eS-{v)}. 



An identical comment to Remark 12.21 applies to sub-solutions. The next lemma is 
actually obvious: 

Lemma 2.1. Assume g, I and u are bounded. Then and V~ are nonempty. 

Remark 2.3. We decided to work in the framework of bounded I, u and g to 
minimize technicalities related to integrability. However, our method works in more 
general situations. If / and u are assumed unbounded, then we need the additional 
technical assumptions 

(i) V+ and V~ are nonempty. This is always the case if I and u are actually 
continuous. 

(ii) for each (s,x) we need that 



up (i{t,xr)\ + \u{t,xr)\) + \g{xn\ 

t<T ^ ' 



sup 

.0< 



< oo. 



This is the usual assumption made in optimal stopping or Dynkin games. 

The next result is quite clear and represents a counterpart to something similar 
in [1]. However, it needs assumptions on the semi-continuity of the obstacles. 

Lemma 2.2. (i) If u is lower semi- continuous (LSC) then for each v G 

we have v > v* . 

(ii) /// is upper semi- continuous (USC) then for each v £ we have v < v^. 
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Proof. We only prove part (ii) since the other part is symmetric. Using the LSC 
of V (since v is actually continuous) and the USC of we conclude that the set 
S~{v) = {v < 1} is closed. This means that, denoting by :— r~(u; s, a;, s), we 
have 

II{r-<p}«(r-,^:-) < I{.-<p}/(r-,X;L^) 
for each p G T^'^ . Applying the definition of Stochastic sub-solutions between the 
times 

Pi--= s< p2 p, 

together with the definition of the cost J and the fact that v < u we obtain that 

v{s,x) < E^'^Ht- Ap,X'^^^^^)] < J{s,x,T-,p). 
Taking the inf over p, we conclude that 



vls,x) < inf J(s,x,T ,p)<w»(s,x). 



□ 



(5) 



We assume now that I is USC and u is LSC. Following [1] and using Lemmas 
OandO we define 

w~ :— sup V < v^, < V* < v'^ :— inf w. 

The next result is actually the main result of the paper. 

Theorem 2.1. (Stochastic Perron's Method) 

(i) Assume that g, I are USC and u is LSC. Assume, in addition that 
(4) there exists v G such that v < u. 

Then, is a bounded and USC viscosity sub-solution of 

F{t, X, V, vt,v^, v^^) < o« [0, T) X W^, 
v{T, ■) < g. 

(ii) Assume g, u are LSC and I is USC. Assume, in addition that 
(6) there exists v G such that v > I. 

Then, is a bounded and LSC viscosity super- solution of 

F{t, x, V, vt,v^, Vr^) >0 on [0, T) x W^, 
viT, •) > g. 

Remark 2.4. Assumption is satisfied if the upper obstacle u is continuous, and 
Assumption ([6|) is satisfied if the lower obstacle I is continuous. 

We have ^^{T, ■) > g and v~{T, ■) < g hy construction. Therefore, the terminal 
conditions in ([5]) and ([7]) can be replaced by equalities. The proof of the Theorem 
12. H is technically different from the proof in L. The main reason is that, we cannot 
prove directly that 

even if we weaken the continuity of super-solutions in V+ to USC and the continuity 
of sub-solutions in V~ to LSC. This technical hurdle is circumvented by the weaker 
lemma below, together with an approximation argument in Lemma 12.41 



(7) 



Lemma 2.3. (i) Assume u is LSC. Ifv^,v'^ e V+, then A G V+. 

(ii) Assume I is USC. Ifv^,v'^ e V", then v'^ V £ V". 
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Proof. Wc prove item (ii). It is easy to see that v :— V is continuous as 
well as w < M and ?;(T, •) < g. The only remaining thing to prove is for each 
(s,x) e [0,T] X R'', and any stopping times 

(8) ) < [«(P2 AT-,x;f^^_)|7-;f 

where the stopping time t~ is defined by r~ = t~(w; s,x,/9^). In other words, we 
want to prove the sub-martingale property of v along the process X**'^ in between 
the stopping times p\ < /92 A t~. The idea of the proof relies on a sequence of 
stopping times (7n)n>o defined recursively as follows: set 70 = pi and then, for 
each n = 0, 1, 2, . . . 

(i) if v{'yn,X^J < Kln,XjJ, then 7„+i := 7„ 

(ii) if v{-yn,X^J = v^{^n,XjJ > Z(7„,X^„), then 

7„+i := inf{t G [7„,T] : {v\t,Xt) < l{t,Xt)}. 
In this case, we note that (7„+i, X^^^^) < v{'yn+i,X^^^^) and 

wH7n+l,^7. + l) < '(7«+l,^7r.+l)- 

(iii) iiv{'yn,X^J = v^{'-fn,X^J > l{jn,X^J, then 

,,2 



7„+i :=inf{t€ [7„,T] <Ki,^t)}- 

7,.+i) < ^^(7n+l,^7n+i 



In this case, we note that w^(7„_|_i,X^^ ) < v{'yn+i,X^ ) and 



?^^(7n+l,^7»+l) < '(7n+l,^7«+i)- 

One can use the definition of stochastic sub-solution for in between the times 
7n < 7n+i, together with the observation following item (ii), or the definition of 
stochastic sub-solution for in between 7„ < 7,1+1 and the; observation following 
item (iii), to conclude that, for any n > 0, v{t,Xt) satisfies the sub-martingale 
property in between 7„ < 7„+i. Concatenating, we conclude that, for each n, we 
have 

(9) v{pi,x;f) < E [«(P2 A7„,x;;i^j|7-;f] . 

Now, care must be taken in order to pass to the limit as n — >■ 00. By construction, 
it is clear that 7„ < t~ . On the event 

A -.= {{3) no, jn = r~,n>no}, 

it is very easy to pass to the limit, since the sequence is constant eventually. How- 
ever, on the complementary event 

B:={7n<T-, (V)n}, 

we have to be more careful. Depending on parity, for each u! € B, there exist 

n-o = no(w) such that 

vHlno+2k,X^:^^J < l{jno+2k,X;':^^J for fc > 

and 

v\^no+2k+uX;':^^^^^J < Z(7„„+2fe+l,X«f^^^^^J for k>0. 

This comes from the very definition of the sequence 7„. Since both and are 
LSC (actually continuous) and I is USC, we can pass to the limit in both inequalities 
above to concluded that for 7^0 := lim„ 7„ we have 

^;(7oo,X«;:)</(7oo,X«;:) on B. 
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To begin with, this shows that 700 > so 700 = on B. However, 700 — as 
weU on A. Now, we let n — 00 in ([9]) using the Bounded Convergence Theorem, to 
finish the proof. 

Tliis proof uses essentially the continuity of and u^. However, using more 
technical arguments, one could prove something similar assuming only the LSC 
property for stochastic sub-solutions. 

□ 

Proof of Theorem \2.1\ 

We will only prove that w+ is a sub-solution of ([S]): the other part is symmetric. 
Step 1. The interior sub- solution property. Note that we already know that is 
bounded and upper semi-continuous (USC). Let 

^ : [0, T] X M'* ^ R 

be a C^'^-test function function and assume that v'^ — ip attains a strict local 
maximum (an assumption which is not restrictive) equal to zero at some interior 
point (to,a;o) £ (0,r) x W^. Assume that w+ does not satisfy the viscosity sub- 
solution property, i.e. 

min{(^(to, xq) - l{tQ, zq), max{-(p(io, xq)* - Lt(p{to, xq), (p{to,xo) - u{tQ, xq)}} > 0. 

According to Assumption (|4]) (and this is actually the only place where the assump- 
tion is used), we have w+ < u. This means 

V^{.to,Xo) > l{to,Xo), 

and 

-(pt{to, xo) - Lf(p{to,xo) > 0. 

Since the coefficients of the SDE are continuous, we conclude that there exists a 
small enough ball B{tQ,XQ,e) such that 

-ift - Lfip > on B{to, Xo, s), 

and 

93 > ti+ on B{to,xo,e) - {to,xa). 

In addition, since ip{to,xo) = v^{to,xo) > l{tQ,xo) and (p is continuous and I is 
USC, we conclude that, if e is small enough, then 

ip — e > I on B{to, xq, e). 

Since ~ ip is upper semi-continuous and B(to,xo,e) — B(ta,xo,e/2) is compact, 
this means that there exist a. 5 > Q such that 

ip- S>v+ on B{tf), xq, e) - B{tn,xo, e/2). 

The next Lemma is the fundamental step in the proof by approximation (and 
represents a major technical difference compared to the previous paper [I]). This 
is the result that actually allows us to work with stochastic semi-solutions which 
are continuous. 

Lemma 2.4. Let < 5' < 5. Then there exists a stochastic super-solution v € 
such that 

ip - S' > V on B{to, Xq, e) - B{tQ,xo,e/2). 
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Proof of Lemma \2.4\ Using Lemma l2 . 31 together with the resuh in the Appendix of 
[1], we can choose a decreasing sequence {vn)n>o C V+ of stochastic super-solutions 
such that 

Now the proof follows the idea of Dini's Theorem. More precisely, we denote by 

An {vn >V>-S'}n (Wto^x^ - B{ta,xo,e/2)y 

We have that An+i C An and Ci^^^An — 0. In addition, since u„ is USC (being 
continuous) and tp is continuous as well, each An is closed. By compactness, we get 
that there exits an uq such that An„ = 0, which means that 

ip-d'>Vna, on B{to,xo,e) - {to,xo). 

We now choose v := w„o . □ 
We finish the proof of the main theorem as follows. Let v € be given by 
Lemma 12.41 Choosing < rj < S' A e small enough we have that the function 

satisfies the properties 

- Ltf'^ > on B{to, xq, e), 
(f"^ > V on B{to, xo,e) — B{to, xq, e/2), 
(f"^ >l on B{to,xo,e), 

and 

ip''{tQ,xo) = v+(to,xo) - rj. 
Now, we define the new function 

^ f w A vs'' on 5fto,xo,£) , 
\ u outside 5(^0, 2^0 J £)■ 

We clearly have v"^ is continuous and w''(io,a;o) — (p^'{to,xo) < v'^{to,XQ). Also, v'^ 
satisfies the terminal condition (since e can be chosen so that T > to + e and v 
satisfies the terminal condition). It only remains to show that E V+ to obtain a 
contradiction. 

We need to show that the process {v^^ (t, X^''^))s<t<T is a super-martingale on 
(fJ'''^, P"'^) with respect to the filtration {J^t'^)s<t<T in the upper continuation 
region C"*" := {v'^ < u}, i.e. satisfies item (ii) in Definition 12.11 

The sketch of how to prove this can be given in three steps: 

1. the process {v^ {t, Xf'^))s<t<T is a super-martingale locally in the region 
^[s,T] X M'^ — B(tQ,XQ,e/2)j D C+ because it coincides there with the process 
{v{t, X^'^))s<t<T which is a super-martingale in (in the sense of the Definition 

1211). " " 

2. In addition, in the region B{to,xo,s) the process {v'^{t,X^'^))s<t<T is the 
minimum between a local super-martingale (^p^) and a local super-martingale as 
long as V < u. One needs to perform an identical argument to the sequence of 
stopping times in the proof of Lemma 12.31 to get that we have a super-martingale 
in B{to,xo,£). 

3. The two items above can be easily concatenated as in the proof of Theorem 
2.1 in [1]. More precisely, we exploit the fact that the two regions in items 1 and 2 
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overlap over the "strip" B{to,XQ,£) — B{to,XQ,£/2), so the concatenating sequence 
is the sequence of "up and down-crossings" of this "strip" . This concludes the proof 
of the interior sub-solution property. 

Step 2. The terminal condition. Assume that, for some a;o 6 I^'' we have 
v~^{T^X()) > g(xo) > 1{T,xq). We want to use this information in a similar way to 
Step 1 to construct a contradiction. Since g and / are USC , there exists an e > 
such that 

max{Z(t, a:), < u^(T', xo) — £ if max{|a; — a;o|, T — t} < £. 

We now use the fact that u+ is USC to conclude it is bounded above on the compact 

set 

B{T, xo,e) - BiT, xq, e/2)) n ([0, T] x R"*). 
Choose 77 > small enough so that 

(10) w+(T,xo) -f — > e+ sup v+{t,x). 

Using a (variant of) Lemma [2.41 we can find a w G V+ such that 

(11) v+{T,xo) + — > e + sup v{t,x). 

^ {t,x)e{B{T.xo,e)-B{T,xo.,e/2))nilQ,T] xB"*) 



We now define, for fc > the following function 

n^h/. \ -l-/rr^ \ . I-'' ~ ■''0 



'^^'^''{t, x) = v+{T, xo) + \^-^ + k{T - t). 



For k large enough (but no smaller than e/2ri), we have that 

-ifi'i'^''' - Ctip'^"^^ > 0, on B{T, xo,e). 
We would like to emphasize that, for convenience, we work here with the norm 

\\{t,x)\\ = niax{|i|, ||a;||}, {t,x) e R x M'', 

where ||a;|| is the Euclidean norm on M'*. With this particular norm, we can use 
pT|) to obtain 



^e,ri,k > £ _,_ ^ on {B{T, xo, e) ~ B{T, xq, e/2)) n ([0, T] x R'^). 

Also, 

^='''''=(T,x) >v+{T,xo) >g{x)+eioT |x-.to| <£ 

and 

(^^''''''(i,a;) > v+{T,xo) > l{t,x)+e for max{\x - xo\,T - t} < e. 
Now, we can choose 6 < e and define 

^e,v,k,S ^ N A On5 (r,X0,£), 

[ w outside i3(T, Xo, e). 

Using again the ideas in items 1-3 in Step 1 of the proof, we can show that v^'^'''-^ S 
V+ but ^^■''■'=''^(r,a;o) = v+(T,xo) < v+(T,xo), leading to a contradiction. 

□ . 
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2.2. Verification by comparison. 

Definition 2.3. We say that the viscosity comparison principle holds for the equa- 
tion ^ if, whenever we have a bounded, upper semi- continuous (USC) sub-solution 

V of ^ and a bounded lower semi- continuous (LSC) super- solution wo/© then 

V < w. 

Theorem 2.2. Let l,u,g be bounded such that I is USC, u is LSC and g is contin- 
uous. Assume that conditions ^ and ^ hold. Assume also that the comparison 
principle is satisfied. Then there exists a unique bounded and continuous viscosity 
solution V to ^ which equals both the lower and the upper values of the game which 
means 

V^, = V = V*. 

Ln addition, for each [s, x) G [0, T] x W^, the stopping times 

p*{s, x) — p^{v, s, X, s) and t*(s, x) = r~(f , s, x, s) 
are optimal for the two players. 

Proof. It is clear that the unique and continuous viscosity solution of ([2]) is 

~ V^, = V* = . 

The only thing to be proved is that 

p*{s,x) ~ p'^{v,S,X,s), T*{s,x) — T~ {v,S,X,s) 

are optimal strategies. Let w„ an increasing sequence such that t;„ G and 
v~ = sup„ Vn. According to the proof of Lemma 12.21 if we define 

Tn T^{Vn,S,X,s), 

then, for each p £ T*'^ we have 

vn{s,x) < E t)„(T,7 Ap,x''^^^) < j{s,x,t;; ,p). 

Using the definition of J, together with the fact that the lower obstacle I is USC, 
I < u and 1{T, ■) < g < u(T, ■), we can pass to the limit to conclude 

v~is,x) < J{s,x,T^,p), for aU p G T"'"', 

where 

T~ limr" < r*. 

The inequality t~ < t* is obvious taking into account the definition of the two 
stopping times and the fact that Vn < v. Now, since u„ are LSC (actually continu- 
ous) and converge increasingly to the continuous function v = , then we can use 
Dini's Theorem to conclude that the convergence is uniform on compacts \x\ < N. 
Now, we have 

v,,ir-,X^) < /(r-,X;p on {r" < T} D {r^ < T} 

Since Vn v uniformly on compacts, and I is USC we can pass to the limit, first 
in n to conclude that 

vir^-Xl^) < l{T^,Xl-^) on {r^ < T} n {l^^^ < N (V) t}, 
and then lei N oo to obtain 
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This shows that, r* < t^, so t* — t^- To sum up, we have that 

v{s,x) < J{s,x,T*,p), for all p e T"'^. 
Similarly, we can prove 

v{s,x) > J{s,x,T,p*), for all t G T"'^, 

and the proof is complete, showing that p* and t* are optimal strategies for the 
two players. □ 

Remark 2.5. The regularity needed in our main results. Theorems 12.11 and 12.21 
is the minimal regularity needed to ensure that the stopping regions are closed 
and the continuation regions are open. However, unless one has a direct way to 
check (HI and ([5]), the opposite semi-continuity of the obstacles has to be assumed, 
according to Remark 12.41 . Theorem 12.21 can be therefore applied in general when 
the obstacles are continuous. 

3. Optimal stopping and (single) obstacle problems 

The case of optimal stopping can be easily treated as above, assuming, formally 
that the upper obstacle is infinite u — +oo. However, in order to have meaningful 
results. Definitions 12.11 and 12.21 have to be modified accordingly, together with the 
main Theorems 12.11 and 12. 2[ noting that p^ = T, i.e. the minimizer player never 
stops the game before maturity. 

Having this in mind, a stochastic super-solution, is, therefore a continuous ex- 
cessive function in the lingo of optimal stopping for Markov processes. We remind 
the reader that we did not assume the selection X^^^ to be Markov, though. 

One could show easily that i>+ G V+ if the continuity in the definition of V"*" were 
relaxed to USC. Under this USC (only) framework, the corresponding Theorem 
12.11 part (i) can be translated as: the least excessive function is a viscosity sub- 
solution of the obstacle problem. While it is known, in the Markov case that the 
value function is the least excessive function (see 0]), we never analyze the value 
function directly in our approach. We can not show directly that v~ G V~ . Viscosity 
comparison is necessary to close the argument. 

All the proofs of the modified Theorems 12.11 and 12.21 work identically, up to 
obvious modifications. 
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